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1.  INTRODUCTION 


In  this  paper  we  begin  by  introducting  a  new  two-parameter  model, 
to  be  called  NEAR(l),  first  mentioned  in  Lawrance  (1979),  for  a  first-order 
autoregressive  time  series  with  exponentially  distributed  marginals.  The 
model  is  a  first-order  Markov  process.  Suitably  choosing  one  of  the 
parameters  as  a  function  of  the  other  produces  a  one-parameter  first- 
order  autoregressive  process  which  can  give  any  value  of  the  lag  one 
autocorrelation  between  zero  and  one.  One  particular  model  produced  in 
this  way  is  the  EAR(l)  model  introduced  by  Gaver  and  Lewis  (1980);  this 
model  had  the  problem  that  a  "zero-defect"  caused  successive  values  of 
the  process  to  be,  at  times,  fixed  multiples  of  the  previous  values.  The 
NEAR(l)  model  does  not  have  this  defect  except  for  the  EAR(l)  special  case 
and  thus  seems  much  more  suitable  than  the  EAR(l)  model  for  the  modelling 
of  real  data.  In  addition,  the  fact  that  there  are  two  parameters 
indexing  fie  dependency  structure  of  the  model  allows  one  to  consider 
sample  path  behavior  as  well  as  the  customary  fitting  of  the  first  and 
second  order  moments  to  the  data.  The  model  is  defined  in  Section  2. 

At  another  extreme  from  the  EAR(l)  model,  a  one-parameter  model 
(TEAR(l))  is  produced  which  is  much  easier  to  extend  to  higher  order 
autoregressive  structures  than  is  the  EAR(l)  model  (Lawrance  and  Lewis, 
1980).  However  while  it  has  no  zero  defect,  this  TEAR(l)  model  produces 
realizations  which,  for  high  serial  correlation,  tend  to  run  up  most  of 
the  time;  for  the  general  NEAR(l)  model  these  aspects  can  be  adjusted. 

A  one-parameter  model  which  can  mimic  some  of  the  time-reversible  char¬ 
acter  of  normal  AR(1)  proresses  is  produced  from  the  NEAR(l)  model  by 
requiring  either  that  the  probability  of  a  jump  up  from  one  value  to 
the  next  be  one-half  or  requiring  that  the  first  directional  moments  be 


equal.  A  property  which  the  NEAR(l)  model  does  not  share  with  its  special 
EAR(l)  case  is  additivity,  so  that  extensions  to  Gamma  marginals  are  not 
automatic;  other  marginal  distributions  are  possible  with  the  NEAR(l) 
structure  but  these  are  not  discussed  here. 

An  important  property  of  the  NEAR(l)  models  is  that  they  are  simple 
random  linear  combinations  of  independent  exponential  variables  and  there¬ 
fore  easy  to  simulate.  This  simplicity  is  bought  at  the  price  of  auto¬ 
correlations  which  are  nonnegative . 

The  second  thrust  of  the  paper  concerns  alternation  and  negativity 
of  autocorrelations;  this  will  be  achieved  by  a  scheme  coupling  two  antithetic 
NEAR(l)  sequences,  a  scheme  introduced  by  Gaver  and  Lewis  (1980)  for  the  negatively 
correlated  EAR(l)  process.  The  resulting  model,  to  be  called  the  NEARA(l) , 
includes  both  the  NEAR(l)  and  hence  TEAR(l)  as  special  cases;  it  has  auto¬ 
correlations  which  alternate  into  negativity  under  a  geometrically  decaying 
envelope.  However,  simulation  of  the  negatively  dependent  models  involves 
random  linear  combinations  from  independent  pairs  of  negatively  dependent 
exponential  variables,  and  this  can  be  complicated.  Most  developments  in 
the  paper  are  undertaken  for  the  general  NEARA(l)  model,  and  further  detail¬ 
ing  of  results  are  given  separately  for  the  positive  and  negative  dependency 
cases.  In  particular,  the  paper  deals  with  the  allowable  range  of  lag  one 
autocorrelations,  lag  r  bivariate  distributions,  exponentiation  of  the 
models  to  have  uniform  marginal  distribution,  and  aspects  of  time  reversi¬ 
bility,  sample  path  behavior  and  estimation. 

Simulation  aspects  of  the  models  are  discussed  in  Lawrance  and  Lewis 
(1980);  detailed  graphical  representations  of  different  sample  path 
behaviors  are  also  given  there. 
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2.  CONSTRUCTION  OF  THE  MODELS 


The  conventional  linear  autoregressive  model  (AR(1))  with  exponential (X) 
marginal  distributions  (Gaver  and  Lewis,  1980)  takes  the  form 


X 

n 


^  Vi  ^ 


0  w.p.  p 

E  w.p.  1-p 

n  r 


n  =  0,1,2, .. . 


(2.1) 


where  p  is  a  parameter  (0  <  p  <  1)  and  the  E  ,  n  =  0,1,2,...  are  inde- 

n 

pendent  exponential  variables  with  parameter  X  >  0.  This  EAR(l)  model  has 
serial  correlations  of  order  r,  p^  =  corr (X^,X^^^)  ,  given  by  p and  gen¬ 
erates  sample  paths  in  which  large  values  are  followed  by  runs  of  falling 
values  with  geometrically  distributed  run-length.  The  large  values  arise 
when  E^  is  Included,  while  the  falling  values  stem  from  the  selection  in 

(2.1)  giving  only  X  =  pX  This  behavior  is  likely  to  limit  the  broad 

n  n-i 

applicability  of  the  model,  although  it  can  be  overcome  the  more  complicated 
moving-average  and  mixed  moving  average-autoregressive  developments  (Lawrance 
and  Lewis,  1977,  1980a;  Jacobs  and  Lewis,  1977). 

An  alternative  exponential  first-order  autoregressive  Markov 
model  is  obtained  by  interchanging  the  Independent  and  identically  distri¬ 
buted  variables  ^nd  in  (2.1);  this  can  have  no  effect  on  the 

exponential (X)  marginal  distribution  of  Proceeding  this  way,  with 

p  replaced  by  1-a ,  we  have  the  model 


X 

n 


(1— a)E  + 
n 


X^-1  w.p.  a 


0  w.p.  1-a 


n  =  0.k,2, , 


(2.2) 


This  exponential  AR(1)  model,  called  TEAR(l),  is  again  Markovian  and  has 
the  a  correlation  structure  of  the  EAR(l)  model;  it  is,  as  will  be  shown 
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later,  particularly  tractable  analytically.  The  characteristic  behavior  of 

realizations  generated  by  this  model  (particularly  distinct  when  a  is 

large)  is  that  of  runs  of  rising  values  (with  geometrically  distributed 

run  length)  when  the  selection  (l-a)E^  +  is  being  made,  followed  by 

a  sharp  fall  when  the  selection  (l-a)E^  is  made  without  inclusion  of  the 

previous  value.  Illustrations  of  these  effects  both  for  the  EAR(l)  and 

TEAR(l)  models  are  given  in  the  simulations  of  Fig.  la  and  Fig.  lb.  These 

simulated  sample  paths  use  the  same  simulated  exponential  error  sequence 

{  E  }  . 
n 

Broader  behavior  in  realizations  generated  by  an  exponential  model 

can  be  obtained  from  the  model  in  which  the  X  ,  of  (2.2)  is  scaled  by 

n-1 

a  coefficient  6.  This  gives  the  proposed  NEAR(l)  model  (Lawrance,  1980) 
as 

BX  ,  w.p.  a 
n-1 

j  n  =  0,1,2 .  (2.3) 

n  n 

0  w.p.  1-a 

where  the  existence  and  distribution  of  the  i.l.d.  sequence  which 

makes  the  X^'s  in  the  stationary  case  have  exponential (X)  distributions, 

needs  to  be  established  afresh.  We  now  show  that  e  must  have  a 

n 

particular  mixed  exponential  distribution. 

Let  the  Laplace-Stieltjes  transforms  of  the  X  and  e  variables 
be  denoted  by 

())^(s)  -  E{e"®*}  and  4.  (s)  =  E{e"®'^}  .  (2.4) 

A  C 

Then  (2.3)  gives,  if  we  assume  stationarlty. 


(2.5) 


<l>^(s) 


oi'J'^CBs)  +  (1-a) 


X  +  Bs  _ X _ 

X  +  8  X  +  (l-a)Bs  ’ 


on  using  <t>„(s)  =  X/(X  +  s).  Thus,  providing  a  and  B  are  not  both  equal 
to  one,  can  be  generated  from  an  by  the  exponential  mixture 


c 

n 


E 

n 

< 


(l-Qi)BE^ 


1  -  B 

"•P*  1  -  (l-a)6 

n  =  0,1 . 

uB 

1  -  (l-a)B 


(2.6) 


When  a  «■  0  or  B  =  0  the  exponential  i.l.d.,  whereas  with 

a  =  1  the  EAR(l)  model  (2.1)  Is  obtained  with  =  6.  When  B  =  1  the 

TEAR(l)  model  is  obtained.  Thus  the  two-parameter  exponential,  first-order, 

autoregressive  Markov  NEAR(l)  model  can  be  expected,  for  fixed  serial 

correlation  of  lag  1,  =  a6,  to  model  broader  behavior  than  is  obtained 

in  the  extreme  cases  (a  =  1  or  6=1).  In  particular  a  and  B  can  be 

chosen  to  produce  both  runs  of  ascending  and  descending  values,  intermediate 

to  the  profiles  of  EAR(l)  and  TEAR(l)  models,  as  was  illustrated  in  Fig.  la 

or  Fig.  lb.  Figure  Ic  represents  an  intermediate  case  which  will  be  discussed 

in  Section  8.  Note  that  the  correlation  is  the  same,  0.75,  in  all  three  figures. 

It  is  also  clear  from  the  Markovian  nature  of  the  model  (l.e.  that 

conditional  on  X  ,  =  x  ,  the  distribution  of  subsequent  values 
n-1  n-1  ^ 

X  ,  X  .1,  ...  is  independent  of  X  ^.X  _,...),  that  if  X„  is 

n  n+1  n-2  n-3  0 

exponential (X)  and  independent  of  E, ,  ...  ,  then  the  process  X  , 

n  =  1,2,...  is  stationary.  Note  too  that  the  NEAR(l)  model  is,  by 
definition,  explicitly  (physically)  autoregressive  and  thus  not  only  auto- 
regeresslve  in  the  sense  that  E(X  Ix  _.  =  x)  is  a  linear  function  of  x. 
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We  note  too  that  the  NEAR(l)  model  gives  a  solution  to  the  (random) 


where  the  serially  independent  binary  pairs  and  generally  have 

negative  dependency.  Some  insight  into  the  model  comes  from  seeing  that 
is  positively  dependent  on  this  is  negatively  dependent  on 

so  making  and  X^  ^  negatively  dependent.  Though  defined  compactly 

in  terms  of  the  two  processes,  the  Interest  here  is  in  the  marginal  process 
X^.  A  univariate  description  of  X^  is  possible  and  given  at  equation 
(3.2). 

The  special  case  of  the  bivariate  sequences  (e  ,  e'}  and  {V  ,  V'} 

^  n  n  n  n 

in  which  e  =  e'  and  V  =  V'  recovers  the  NEAR(l)  model.  The  special 
n  n  n  n 

case  when.  6=1  will  be  called  the  TEARA(l)  model. 

Detailed  aspects  of  the  sequence  depend  on  the  joint  distri¬ 

butions  of  {e  ,  e'}  and  {V  ,  V'},  though  the  marginal  distributions  of 
n  n  n  n 

and  must  be  as  at  (2.6)  for  X^  to  be  marginally  exponential.  For 

instance  for  the  TEARA(l)  model,  strongest  alternation  in  serial  correlations 
is  obtained  when  the  are  maximally  negatively  correlated  expo¬ 

nential  variables  and  therefore  are  antithetic  pairs,  and  similarly  for 
the  binary  pairs  broader  NEARA(l)  model,  (2.8), 

negatively  correlated  mixed  exponential  variables  ®re  required. 

Some  of  these  aspects  of  the  model  are  explored  in  general  and  for  specific 

(e  ,  e'}  and  {V  ,  V'}  distributions  in  Sections  4  and  5.  In  this 
n  n  n  n 

respect  this  paper  extends  results  and  details  for  the  negatively  correlated 

EAR(l)  model  given  by  Gaver  and  Lewis  (1980). 

Note  that  while  {X  ,  X'}  is  a  bivariate  Markovian  model,  the 
n  n 

full  Markovian  property  of  X^  individually  is  lost  unless  it  reduces  to 
the  NEAR(l)  model;  that  is  to  be  expected  from  the  cross-dependency  built 


into  the  model. 


3.  AUTOCORRELATION  STRUCTURE  OF  THE  MODEL 

The  simple  autocorrelation  structure  of  the  NEARA(l)  model,  as 
given  at  (2.8)  by 


e  +  6V  X' 
n  n  n-1 


X'  =  e’  +  ev'x^  , 

n  n  n  n-1 


(3.1) 


✓ 


is  best  approached  by  recursively  expressing  the  dependency  of  on 

either  X'  ,  X  X’  ,  X  ......  and  so  on.  Directly  from  (3.1)  it 

n-1  n-2  n-J  n-4 

can  be  noted  that  the  distribution  of  simply  expressed  in 

terms  of  the  distribution  of  (X  ..X'  ,):  in  fact,  this  latter  joint 

n-i  n-x 

distribution,  equivalently  (X^,X^) ,  plays  a  central  role  in  the  process. 
However,  substituting  for  X^_j^  in  the  first  equation  (3.1)  from  the 
second,  gives 


X 

n 


e  +  6V  e' 
n  n  n-1 


+  e^v’  ,V  X  „ 
n-1  n  n-2 


(3.2) 


Hence  the  joint  distribution  of  (X  ,X  „)  does  not  need  to  be  expressed 

n  n— i 

in  terms  of  (X  ,X')  and  this  is  very  convenient.  Generally,  there  is  this 
n  n 

distinction  between  the  odd-r  and  even-r  cases  of  ^^n’*n-r^*  shown 

in  the  following  key  expressions  which  are  obtained  by  repeated  substitutions 


n  n 


n  n 


+  6V  e'  ,  +  e^V  ..V  G  _  + 
n  n-1  n-1  n  n-2 

•  •  •  +  (3 

+  (3’^V  •  ••  V’  V  X’  ); 

'  n-r+1  n-1  n  n-r 

(r 

+  6V  g'  +  e^v'  V  G  .  +  • 

n  n-1  n-1  n  n-2 

+  (B’^V'  V,  V  X  )  . 

n-r+1  n-1  n  n-r 

(r 

n-r+2 


V  .,) 

n-1  n-r+1 


(3.3) 


n-r+2 


V  e'  ., ) 

n-1  n  n-r+1 


(3.4) 
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The  autocovariances  of  {X  }  follow  easily  from  (3.3)  and  (3.4).  On 

n 

noting  that  the  indicator  variables  {V^}  occur  independently  in  the 
products,  we  have 


E(V'  •••  V’  ,V  ) 

n-r+1  n-1  n 


(3.5) 


and  hence 


Cov(X  ,X  ) 
n  n-r 


(aB)’^  Var(X  )  (r  even) 

n— r 

(aB)^  Cov(X  ,X'  )  (r  odd)  . 

n-r  n-r 


(3.6) 


In  terms  of  correlations,  this  central  result  becomes 


Corr(X  ,X  ) 
n  n-r 


Jl* 

(aB)  (r  even) 

(aB)^  Corr(X  ,X')  (r  odd)  . 

n  n 


(3.7) 


Alternation  of  these  autocorrelations  under  a  geometric  envelope  is  evident; 

negativity  of  the  odd  lag  correlations  requires  the  negativity  of 

Corr(X  ,X').  For  the  simpler  NEAR(l)  model  in  which  X  =  X'  the  Markov 
n’  n  f  '  n  n 

(aB)^  correlation  structure  is  evident. 

For  the  NEARA(l) ,  an  investigation  of  Corr(X^,X^)  is  required. 

To  this  end,  multiply  together  the  respective  sides  of  the  two  equations 
(3.1),  giving 


X  X'  =  e  e'  +  BV'e  X  ,  +  BV  e'X'  ,  +  B^V  V’X  ,X'  ,  (3.8) 

n  n  n  n  n  n  n-1  n  n  n-1  n  n  n-1  n-1 


and  take  expectations.  Let 


€  =  Cov(e  ,e') 
n  n 


and  V  =  Cov(V  ,V') 

n  n 


(3.9) 
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and  assume  statlonarity .  Then  following  from  (3.8)  there  is  the  result 


Corr(X  ,X')  -  (€  +  e^v)/{l  -  (ot^+v)6^}.  (3.10) 

n  n 

The  Important  conclusion  is  that  maximum  negativity  of  Corr(X^,X^)  is 
obtained,  for  any  fixed  values  of  a  and  8,  for  maximum  negative  correla¬ 
tions  within  the  pairs  (e  ,e')  and  (V  ,V').  The  proof  is  omitted. 
Obtaining  this  maximum  negative  correlation  by  the  use  of  antithetic 
variables  is  developed  in  the  next  section. 


4.  ANTITHETIC  ASPECTS  OF  THE  MODEL. 

It  is  simplest  to  deal  first  with  the  binary  (V  ,V')  variables: 

n  n 

the  basic  antithetic  idea  is  to  relate  the  distribution  of  V  to  a 

n 

monotonic  transformation  of  a  uniform  variable  U  on  (0,1);  then  V 

n 

is  the  same  transformation  of  1  -  U  which  also  has  a  (0,1)  uniform 
distribution.  The  variables  and  are  then  maximally  negatively 

correlated.  Thus,  we  define 


V  =  1 
n 

if 

u 

n 

<  a 

V’ 

n 

*  1 

if 

1-U 

n 

or 

u 

n 

> 

l-a 

o 

II 

if 

U 

n 

>  a 

V 

n 

=  0 

if 

1-U 

n 

>  a 

or 

U 

n 

< 

1-a 

The  resulting  joint  distribution  takes  one  of  two  forms,  as  given  below, 
depending  on  whether  a  <  1/2  or  a  >  1/2: 
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V  - 
n 

1 

0 

v» 

n 

V'  «  1 
n 

0 

a 

a 

0 

a 

l-2a 

l-ot 

V 

n 

a 

1-a 

1 

(a  <  1/2) 


V  * 
n 

1 

0 

v 

n 

V'  *  1 
n 

2a-l 

1-a 

a 

0 

1-a 

0 

1-a 

V 

n 

a 

1-a 

1 

(a  >  1/2) 


(4.1) 


2  2 

The  resulting  covariances  are  v  =  -a  for  0  _<  a  ^  1/2  and  v  =  (1-a) 
for  1/2  ^  a  <  1;  the  corresponding  correlations  are  thus  -a/(l-a)  if 
0  j<  a  _<  1/2  and  -(1-a) /a  if  1/2  £  a  <  1.  The  a  =  1  case  is  exceptional 
and  is  excluded  since  it  leads  to  the  negatively  correlated  EAR(l)  model 
treated  in  Gaver  and  Lewis  (1980) . 

Next  we  consider  how  to  obtain  a  bivariate  mixed  exponential  dis¬ 
tribution  for  (g  ,e')  having  maximum  negative  dependency.  In  the  case 
n  n 

of  positive  continuous  random  variables,  the  maximum  negative  correlation 

is  obtained  by  the  antithetic  pair  (Moran,  1967) .  However,  with 

having  mixed  exponential  marginals,  the  full  antithetic  distributions 

cannot  be  obtained  explicitly  since  the  inverse  distribution  function  F  ^(O 

cannot  be  obtained  explicitly.  An  alternative  way  of  obtaining  negatively 

correlated  (g  ,g')  begins  by  noting  that 
n  n 

e  -  K  E  and  e»  =  K'E‘<  (4.2) 

n  n  n  n  n  n 

where  marginally,  from  (2.6), 
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1 


w.p.  (l-6)/{l-(l-a)B} 


K  ,  K' 
n  n 


(4.3) 


(l-a)6  w.p.  a6/{l-(l-a)3} 


and  E  ,  E*  are  exponent ial(X)  variables,  marginally.  The  dependency  of 
n  n 

e  and  e '  is  then  given  by 
n  n  a  j 


Cov(e  -  (X  ^  +  C„)C„  +  [E(K)]^  r  , 

n  n  c.  K  £. 


(4.4) 


where  CL,  is  the  covariance  of  K  and  K'  and  C_  is  the  covariance 

of  E^  and  E^.  Although  any  negatively  correlated  bivariate  exponential 

can  be  used  for  {E,E'),  the  most  negative  correlation  is  attained  in  the 

(degenerate)  antithetic  case.  The  antithetic  choice  for  (K^,K^)»  whose 

distribution  follows  (4,1)  with  a  replaced  by  (l-E)/{l-(l-a)S} ,  does 

not  involve  degeneracy.  These  antithetic  choices  should  give  a  negatively 

correlated  mixed  exponential  pair  whose  correlation  is  almost 

as  negative  as  the  true  antithetic  bivariate  mixed  exponential  pair. 

Note  that  the  distribution  of  this  bivariate  mixed  exponential  pair 

(e  ,e')  is  a  little  complicated  in  view  of  the  break  in  form  of  the 
n  n 

antithetic  distribution  of  the  binary  pair  (K  ,K’)  at  (l-6)/{l-(l-a)E}  “  1/2 

n  n 

or  B  =  l/(l+a).  Covariance  calculations  using  (4.4)  then  give  the  result 


X  ^Cov(e  ,e') 
n  n 


(l-2og)(l-Tr^/6)  -  (aB)^  for  B  <  1/(1-Kx) 

(4.5) 

(l-a)B(2-a6-B)  (l-ir^/6)-(l-B)^  for  B  >  l/(l+a). 
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This  expression  will  now  be  used  In  determining  explicit  results  for  the 
first  autocorrelation  of  the  NEARA(l)  model.  Other  less  degenerate 
negatively  correlated  exponential  random  variables  can  be  used;  the 
simplest  and  most  easily  utilized  one  Is  given  by  Gaver  (1972). 


5.  THE  FIRST  AUTOCORRELATION 


The  first  autocorrelation  of  the  NEARA(l)  model  can  now  be  obtained, 

and  Its  range  of  values  will  be  determined,  both  generally  and  In  the 

6=1  case,  the  so-called  TEARA(l)  model.  Interest  Is  In  the  degree  to 

which  negativity  can  be  attained,  bearing  In  mind  that  with  exponential 

2 

marginal  distributions  there  Is  a  theoretical  lower  bound  of  (l-ir  /6)  =-0.6449 
on  the  correlation.  From  (3.7),  (3.10)  and  (4.1)  we  have 

f  a6€-(aB)^  for  0  <  o  <  1/2 


p  =  Corr(X  ,X  ,)  = 
1  n  n— 1 


(5.1) 

aB{€-(l-a)S^}/{l-(2a-l)B^}  for  1/2  <  a  <  1. 


This  result  is  combined  with  €  from  (4.5)  to  give  the  most  general 
expression 


a6  (l~2a6)  (1— iT^/6)-2(a6  )  ^, 


0  <  a  <  1/2,  6  <  l/d-Kx) 


o6^(l-a)(2-ae-6)(l-7r^/6)-a6(l-B)  -(a6)  ,  0  a  ^  1/2,  B  >  l/(l;hii) 

{oB(l-2a6)(l-Tr^/6)-(aB)^-a(l-a)^B^}/{l-(2a-l)B^} 

1/2  ^  a  <  1,  B  <  l/(l+o) 

{o(l-a)6^(2-aB-B)(l-Tr^/6)-a8(l-B)^-a(l-a)^6^}/{l-(2o-l)B^} 


(5.2) 


1/2  <  a  <  1,  B  >  l/(l+a). 


In  the  TEARA(l)  special  case  (g  =  1)  there  is  the  simpler  result; 

f  a(l-a)^(l-ir^/6)  -  0  <  a  <  1/2 

^1  =  ■ 

a(l-a)  (l-Tr^/6)  -  a(l-a)  1/2  ^  a  <  1  . 


(5.3) 


The  maximum  negative  value  for  (5.3)  is  at  a  =  1/2,  the  join  point  of 
the  two  monotonic  parts  of  (5.3),  and  here  =  -0.2056.  A  grid  of 
values  of  for  NEAR(l)  models  with  a  =  0(0. 1)0. 9,  &  =  0(0. 1)1.0 

is  given  in  Table  1;  it  is  seen  that  the  point  (a,B)  =  (0.5,1)  also 
gives  the  overall  maximum  negative  value. 

These  bounds  do  not  come  very  close  to  the  theoretical  lower  bounds 
of  -0.6449;  however,  it  must  be  recalled  that  this  is  only  obtained  in 
the  highly  singular  case  in  which  one  variable  is  a  function  of  the  other. 
In  fact,  exponential  antithetic  pairs  are  of  the  form  {X,  log(l-e  )). 
Nevertheless,  there  is  room  for  improvement,  but  our  results  seem  the  best 
possible  within  the  proposed  type  of  model.  For  instance,  in  the  TEARA(l) 
case,  it  is  perhaps  worth  noting  that  if  the  variables  had  been 

taken  as  identical,  then  the  minimum  p^^  value  would  have  been  -0.0632; 
similarly  if  they  had  been  taken  as  independent,  then  the  minimum 
value  would  have  been  -0.1106.  The  negatively  correlated  EAR(l)  process 
of  Gaver  and  Lewis  (1980)  has  a  corresponding  minimum  value  of  -0.125. 

The  overall  negative  dependency  in  the  NEARA(l)  process  has  a 
much  stronger  Influence  on  the  sample  path  behavior  than  these  negative 
correlations  suggest.  A  sample  path  for  the  TEARA(l)  process  with 
a  =  .75  is  given  in  Figure  Id  and  shows  the  clear  alternating  behavior. 
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It  is  worth  stressing  that  the  negativity  of  implies  the 

negativity  of  Corr(X^,X^) ;  then  by  virtue  of  the  general  result  (3.7) 
there  is  strong  alternation  in  the  autocorrelations  which  parallels  the 
usual  Markov  correlation  structure  when  p^^  is  negative.  However, 

in  general  the  marginal  NEARA(l)  process  is  not  a  first-order  Markov 
process. 


6.  THE  LAG  ONE  JOINT  DISTRIBUTION 

Following  on  from  the  first  autocorrelation,  the  full  joint  distri¬ 
bution  of  ^^n*^n-l^  Interest  in  describing  the  process  and  match¬ 

ing  it  with  data.  This  joint  distribution  can  be  obtained  from  the  N£ARA(1) 
model  equations  (2.8)  with  the  use  of  Laplace-Stleltjes  transforms;  thus 


<{>„  „  (s,t)  =  E{exp(-SX  -  tX  ,)}  (6.1) 

n’  n-1 

=  E{exp[-s(e  +  BV  X'  )  -  tX  , ]} 
n  n  n-1  n-1 

=  E{exp(-se  -  tX  -  BsV  X'  ,)>.  (6.2) 

n  n-1  n  n-1 


Writing  <(i  (s)  for  E{exp(-SG  )}  and  taking  expectations  with  respect 

n 

to  V  ,  we  have 
n 


♦x  ,X 
n  n-1 


({i^(s){aij!^  ^,(t,Bs)  +  (l-a)(|ij^(t)}  . 


(6.3) 


The  suffix  n  has  been  dropped  from  the  right-hand  side  of  (6.3)  in  view 
of  the  stationary  assumption;  again  the  joint  distribution  of  (X,X')  Is 
required.  However,  when  the  simpler  NEAR(l)  model  allowing  only  positive 
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dependency  Is  considered  so  that  formally  X  =  X' ,  there  is  the  simpler 
result 

^  (s.t)  =  (j)  (s)  +  t)  +  (1-a)  (6.4) 

n’  n-1  ^ 

where  =  A/(X+t).  This  can  be  inverted  but  the  overall  behavior 

can  be  seen  immediately.  With  probability  1-a  there  is  a  scatter  of 

values  X  =  e  independent  of  the  X  variable,  where  as  with  prob- 
n  n  n-1 

ability  a,  X  *  e  +  6X  ,  and  is  always  above  the  line  X  =  BX 

n  n  n-1  •'  n  n-1 

Returning  now  to  the  NEARA(l)  model,  the  joint  distribution  of 

(X,X')  is  required.  By  constructing  Laplace-Stieltjes  transforms  from 

each  side  of  the  model  equations  (2.8),  it  follows  that 


?  ( s ,  t) 
n 


E{exp[-s(e^  +  ev  X'  ,)  -  t(e'  +  BV'X^  , )  ]} 
n  n  n— X  n  n  n-1 

<()^  ^,(s,t)  E{exp(-6tV'X  ,  -  gsV  X'  J}  . 


(6.5) 


Now  the  joint  distribution  of  (V  ,V')  is  available  from  (4.1)  and  so 

n  n 


I  (  3  f 

n’  n 


<(i  ,  (s,  t) 

t  •  fc. 


1  -  2a  +  a(tij^(Bs)  +  a!tij^(Bt), 


0  <  a  <  1/2 


(6.6) 


(2a-l)iji  (6t,Bs)  +  (1-a)  ()>  (Bs)  +  (1-a)  <fi  (Bt) 

Vl’Vl  ^  ^ 

1/2  <  a  <  1  . 


It  is  seen  that,  for  0  ^  a  ^  1/2,  (fi  ,(s,t)  is  immediately  available 

X  f  X 
n  n 

in  terms  of  ((i  ,(s,t)  whereas  for  1/2  _<  a  <  1  a  recursive  calculation 

E  ,e 
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Is  required.  This  simplifies  somewhat  If  It  can  be  assumed  that  the  Joint 


distribution  of  (e,e')  and  hence  the  joint  distribution  of  (X^,X^)  are 
symmetric  In  s  and  t;  there  would  be  no  point  In  assuming  otherwise  for 
univariate  modelling  of  ^  certain  amount  of  calculation  then  gives 

the  final  form  of  (6.6)  as 

[(l-2a) +Qi{<^jj(es)+  <^^(6t)}](t>^^^,(s,t),  0<a<l/2 

(6. 

(1-a)  I  (2cx-l)^I<}.y(6^'^^s)+^„(B^'^^t)]  n  6  ^,(B^s,6^t), 

j=0  ^  ^  1=0 

1/2  £  a  <  1. 

The  series  here  can  be  summed  In  the  3=1,  TEARA(l)  case  when  the  joint 
distribution  of  (e,e')  is  a  bivariate  exponential.  In  the  NEABA(l)  case, 
the  bivariate  distribution  which  has  been  proposed  at  (4.2)  gives 

(<)  ,(s,t)  =  E{exp(-sK  E  -  tK'E')}  (6.8) 

e  ,e  n  n  n  n 


and  this  can  be  expressed  in  terms  of  the  joint  Laplace-Stielt jes  transform 

(ji  ,(s,t)  of  the  underlying  bivariate  exponentials.  Thus 
E  9  E 

2  l-al'af?  +  ♦j.^g,((l-a)Bs,t)} 


+  1-2 


1-  e 


l-(l-a)B 


d'g  g,((l-a)Bs,  (l-a)Bt)  , 


(6.9) 


B  <  l/(l+a) 


1-2 


1-6 


iTl^)?  ♦g^j.,((l-cx)s,t)]. 


6  >  l/(l+a). 


(6.10) 


The  joint  Laplace-Stieltj es  transform  of  the  distribution  of  (E,E’)  in 
the  antithetic  case  is  glven.with  U  a  uniform  (0,1)  random  variable,  by 

s  t 

(j)g  g,(s,t)  =  E{exp[s  log  U  +  t  log  (1-U)]}  =  /  u  (1-u)  du  (6.11) 

u=0 


which  is  a  Beta  function. 

Both  regressions  from  (X  ,X  ,)  of  the  NEARA(l)  model  are  non- 

n  n-i 

linear;  directly  from  the  model  equations  (2.8),  the  forward  conditional 
expectation  is 

E(X  lx  ,  =  x)  =  (l-a6)x"^  +  a6E(X'  ,  |X  =  x)  .  (6.12) 

n  n-i  n-i  n-1 

The  regression  on  the  right-hand  side  is  complicated  but  can  be  obtained 

in  the  6=1  TEARA(l)  case.  With  positive  dependency  only,  (6.12) 

applies  for  the  NEAR(l)  with  formally  X'  ,  =  X  ,  and  so  there  is  linear 

n-i  n-i 

regression  in  this  case  with 

E(XnlXn-i  =  x)  =  (l-a6)A  ^  +  aBx.  (6.13) 


7.  THE  (X  ,X  )  JOINT  DISTRIBUTIONS;  THE  E 5x  ,  SUM  DISTRIBUTIONS 
n  n— r  i  n-1 

These  distributions  follow  directly  from  the  basic  expressions  (3.3) 

and  (3.4)  where  X  is  expressed  in  terms  of  X  or  X'  .  Expecta- 
n  n-r  n-r  ^ 

tlons  are  taken  over  the  Independent  V  ,  V*  ,  . . .  in  turn,  with  the 

n  n-i 

following  results 
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t>  „  (s,t)  -  E{exp(-sX  -  tx  )} 

^n’  n-r 


r-1  . 

n  <|)  (B  s) 
i-0  ^ 


'^X  ^ 

())  (B  s+t)  r  even 
A 


i";!  4  i  i 

+  I  ct^d-a)  n  (B  s)  <t>„(t).  (7.1) 


j-0 


i-0 


In  the  B  =  1,  TEARA(l)  case,  there  is  the  more  explicit  expression, 

,,(s,t)  r  odd 


*'x  X  (l-a)s} 

n’  n-r 


^X,X’ 

<}>^(s  +  t)  r  even 


1  -  [a^  {(l-a)s}]’' 
+  (1-a)  (t)g{(l-a)s>  ^^{t)  • 

b 


(7.2) 


In  Section  8  these  expressions  are  used  to  derive  the  autocorrelations 
of  the  sequence  after  transformation  to  a  uniform  (0,1)  marginal  distri¬ 
bution. 

The  distribution  of  the  sums  can  in  principle  be 

obtained  from  the  expressions  (3.3)  and  (3.4)  in  a  similar  way;  for  instance. 


X  +X  =e  +X  ,+BVX' 
n  n-1  n  n-1  n  n-1 


(7.3) 


X  +X  ,+  X  „  =  c  +G  ,  +  BV  e'  +  d  +  B^V'  V  )X  -  +  BV  X' 
n  n-1  n-2  n  n-1  n  n-1  n-1  n  n-2  n  n-2 


(7.4) 


Generating  functions  for  these  two  sums  can  be  written  down,  but  the  results 
get  progressively  more  complicated.  There  does  not  appear  to  be  any  simple 
general  result,  even  with  the  NEAR(l)  model. 
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8.  RUN  PROBABILITIES  AND  A  PARTIALLY  REVERSIBLE  PROCESS,  PREAR(l) 

We  have  already  indicated  In  Figures  la,  lb,  Ic  that  the  sample  path 
behavior  of  NEAR(l)  processes  c,:n  be  distinctive,  and  is  adjustable  through 
the  two  parameters  a  and  B.  TTiIs  distinctive  behavior  makes  the  model 

very  rich  and  is  principally  observed  as  runs  of  increasing  values  (up-runs) 
or  runs  of  decreasing  values  (down-runs)  or  both  (peaks).  Such 
behavior  is  not  possible  with  Gaussian  AR(1)  models.  In  the  discussion 
which  follows  we  will  explain  the  parameterization  of  the  process 

illustrated  in  Figure  Ic,  which  exhibits  a  partial  time  reversibility. 

A  simple  quantification  of  sample  path  behavior  is  given  by 

P(X  <  X  ,),  which  is  related  to  the  average  length  of  up-run  sequences, 
n  n-1 

Calculation  of  P(X  <  X  ,)  follows  from  (2.3)  as 
n  n-i 

p(x  <  X  ,)  =  (1-a)  p(x^  1  >  ,  >  £„  +  ex  ) 

n  n-1  n-i  n  n-i  n  n-i 

=  (l-ct)  P(X  ,  >  e  )  +  (1-a)  P(X  .  >  E  /(1-6))  .  (8.1) 

n-1  n  n-i  n 


By  using  the  definition  of  given  at  (2.6)  and  the  independence  of 

X  ,  and  e  ,  the  probabilities  in  (8.1)  are  easily  calculated  and  give 
n— 1  n 


P(X  < 


Vi^ 


1  -  g 
l-(l-a)6 


1-6  aB 

2  l+(l-a)B 


l-(l-a)B 


1  aB _ 

l+(l-6)”^  l+(l-B)'^(l-a)6 


(8.2) 


(l-a)(l4B)  .  a(l-B) 

"  2[l+(l-a)6]  (2-a)(l-o6)  ' 
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For  the  TEAR(l)  process  this  probability  (with  B  =  1)  reduces  to 

(l-a)/(2-a)  and  is  thus  always  less  than  one-half,  so  indicating  an 

excess  of  up-runs;  this  is  clearly  illustratt-d  in  Figure  lb.  A  grid  of 

values  of  this  probability  for  a,B  =  0.0(0. 1)1.0  Is  given  in  Table  2. 

The  asymmetry  of  up-run  and  down-run  sequences  for  most  NEAR(l) 

processes  is  evidence  enough  of  their  irreversibility  in  time.  The  value 

of  P(X  <  X  ,)  and  its  difference  from  one-half  gives  one  measure  of  this 
n  n-1 

another  possible  measure  could  be  based  on  the  difference  between  the 

2  2 

directional  correlations  Corr(X  ,  X  -)  and  Corr(X  ,  X  from 

n  n-1  n  n-1 

(2.3)  these  may  straightforwardly  be  obtained  as 

Corr(X  ,  X^  ,)  =  oiB  (8.4) 

n  n— i 

Corr(X^,  X  ,)  =  a6(l  -aB  +  2B)  .  (8.5) 

n  n-1 

The  equality  of  these  two  correlations  suggests  one  definition  of  partial 

reversibility,  and  for  NEAR(l)  processes  gives  the  condition  B  =  l/(2-a). 

The  simulations  in  Figure  Ic  are  for  this  parametrization.  Another 

partial  characterization  of  time  reversibility  would  simply  be  that 

P(X^  <  “  1/2;  surprisingly,  for  NEAR(l)  processes,  this  second 

definition  also  leads  to  the  condition  B  =  l/(2-a)  .  Hence  we  shall 

refer  to  the  NEAR(l)  process  with  B  =  l/(2-a)  as  the  partially  reversible 

or  PREAR(l)  process.  It  is  not  fully  reversible,  even  as  far  as  the 

joint  distribution  of  (X  ,  X  ,)  is  concerned,  but  it  seems  somewhat 

n  n— 1 

remarkable  that  it  is  reversible  in  both  the  run-probability  and 
directional-correlation  aspects. 
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9.  TRANSFOBMATION  TO  A  MULTIPLICATIVE  PROCESS  WITH  UNIFORM  MARGINALS 

One  useful  aspect  of  exponential  processes  Is  that  they  provide  a 

suitable  base  from  which  to  transform  to  other  processes  of  positive  variables 

they  are  particularly  convenient  for  transforming  to  a  multiplicative 

uniform  process;  thus  the  transformed  process  {exp(-XX^)}  is  now  considered, 

with  derivations  of  the  autocorrelations  and  autoregressions. 

When  has  an  exponential  marginal  distribution  with  parameter  X, 

the  variable  U  =  exp(-XX  )  has  a  uniform  (0,1)  marginal  distribution, 
n  n 

The  autocorrelations  of  the  sequence  are  easily  obtained  from  the 

joint  Laplace-Stlelt jes  transform  of  the  joint  distribution  of  (X^,  ; 

thus 

Corr(U  ,  U  )  =  {E(U  U  )  -  l/4}/(l/12) 
n  n-r  n  n-r 

=  12E{exp[-A(X  +  X  ) ])  -  3 
n  n-r 

=  12^^  (X,A)  -  3  .  (9.1) 

n’  n-r 

Working  from  (7,1)  a  reasonably  explicit  result  for  (9.1)  is 
obtained;  the  first  expression  to  be  considered  is 

r-1 

I2a.^  n  <(>  <6  A)  , 
i=0  ^ 

where  is  given  by  (2.5).  After  some  cancellations,  we  get 

r-1  ,  r  . 

12a^  n  f  (B  A)  *  6a'’(l4«’^)  n  {1  +  (l-a)6^}“^  .  (9.2) 

i*0  ^  i=l 
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The  second  term  of  (7.1)  and  (9.1)  is 


12(l-a)  I  n  <()  (B^X)  A  (X)  -  3 

J»0  i-0  * 

=  3(l-a)  I  a^(14e^'‘‘^)  n  (1  +  (l-a)B^'‘’^>"^  -  3  .  (9. 

j  *0  i=0 

This  does  not  look  promising,  at  least  not  until  the  j  “  0  term  is  taken 
out  and  combined  with  the  -3;  the  expression  then  becomes 

I*— 1  ^  ^  J 

3(l-a)  I  a^(l  +  6^'*’^)  n  {1  +  (l-ot)B^'^^)~^  -  3a{l  +  (l-a)6}~^  . 
j=l  i=0 

Next  the  term  j=l  is  taken  out  and  combined  with  the  last  term;  this 
yields 

r-1  j  1 

3(l-a)  I  a^d  +  B^'*'^)  n  {1  +  (l-a)B^‘^^}"^  -  3a^  n  {1+  (l-o)B^'*’^>"^  . 
j=2  i=0  i»0 

Continuing  in  this  fashion  gives  the  final  expression 

r  ^  i  -1 

-3a  n  {1  +  (l-o)B  }  . 

i=l 

Bringing  together  (9.1),  (7.1),  (9.2)  and  (9.4)  gives 


Corr(U  ,U  ) 
n  ti-r 


60*^(146 


<I>X  ®'''“ 

1/(24^’^)  r  odd 


^  1  — 1 
n  {l4-(l-a)B  } 

i-1 


—  "  ( - 

246^^  i=l  Vl4-(l-a)B^' 


r 

n 

1=1 


( - 2 _ ] 

'  l4-(l-a)e^/ 


(r  odd) 

(9.5) 

(r  even) . 


This  Is  the  required  result;  It  Is  computationally  explicit  In  several 
cases:  the  B  =  1  TEARA(l)  model,  the  NEARA(l)  model  for  0  ^  ^  1/2 

and  the  NEAR(l)  model  for  the  full  parameters  region.  This  latter  model 
has  as  Its  transformed  autocorrelation  function 


Corr(U  ,U  )  = 
n  n-r 


3 

2+6*^ 


r 

n 

1=1 


I - - — ) 

Vl4-(l-a)B^  / 


r  =  1,2,...  (9.6) 


The  only  case  of  (9.5)  which  Is  not  available  In  closed  form  Is  the 
NEARA(l)  model  for  1/2  ^  a  ^  1.  The  series  expansion  from  (6.7)  for 

would  require  detailed  examination;  the  lower  bound  of  the 
r=l  case  would  be  Interesting. 

We  now  derive  the  forward  regression  E(U  lu  ,)  of  the  variables 

n  n-1 

In  this  uniform  process;  It  has  previously  been  remarked,  equation  (6.13), 
that  for  exponential  NEAR(l)  variables  this  Is  linear.  As  for  the  auto¬ 
correlations  of  transformed  exponential  processes,  equation  (9.1),  a 
a  general  result  Is  available.  Without  going  Into  details,  this  can  be 
written 

E[exp(-XX^)IX^_^  -  x]*  -  4)x  x  »  <9.7) 

n’  n-1 

where  asterisk  denotes  Laplace-Stleltjes  transform  with  respect  to  x 
of  argument  s.  Inversion  In  the  NEAR(l)  case  gives  the  desired  result 
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(9.8) 


(1  -  »  tou  )  . 

As  to  be  expected  it  is  non-linear.  The  corresponding  backward  regression 
is  also  available  from  (9.7). 

Finally,  we  note  that  the  results  from  Section  8  on  run  behavior 
apply  here  since  the  transformation  used  is  monotonic;  in  particular  the 
uniform  process  is  reversible  in  its  run  behavior  under  the  condition 
6  =  l/(2-a).  However,  reversibility  of  the  directional  correlations  will 
not  be  achieved  under  this  condition,  l.ie  directional  correlations  can 
be  obtained  by  similar  methods  to  those  used  to  obtain  the  ordinary 
correlations . 


10.  ASPECTS  OF  ESTIMATION 

Formal  methods  of  estimation  are  rather  intractable  with  the  NEAR(l) 
models:  as  an  illustration,  in  the  NEAR(l)  case  with  just  one  observation 
after  the  initial  value  x^,  the  likelihood  takes  the  form 


L(a,0;xj^,XQ)  =  (1-a)  fg(Xj^)  + 


oif^(Xi-BXo), 

0 


B  <  Xj^/xq  , 
8  >  x^/xq  , 


(10.1) 


where  ^ j.(')  is  the  mixed  exponential  pdf  of  the  Independent  e 
variables  given  at  (2.6).  With  more  observations,  the  full  likelihood 
becomes,  in  view  of  the  first  order  Markov  structure  of  this 
model,  the  product  of  similar  terms.  The  maximization 
needs  to  be  done  numerically  and  because  of  singularities 


in  the  parameter  space,  the  standard  asymptotic  theory  of  maximum  likeli¬ 
hood  is  inapplicable.  A  discussion  of  the  problems  in  the  a  =  3 

case  of  the  NEAR(l)  model  is  given  by  Raftery  (1979).  When  a  =  1  the 
estimator  proposed  in  Gavcr  and  Lewis  (1980)  is  the  maximum  likelihood 
estimate  (personal  communcation  from  G.  Weiss) .  In  this,  section  we  limit 
ourselves  to  ad  hoc  possibilities  for  estimation  when  a  1. 

The  method  of  moments  can  be  developed  for  the  NEAR(l)  model:  use 
can  be  made  of  the  directional  correlations  (8.4)  and  (8.5).  The 
product  a6  in  (8.4)  is  best  estimated  by  the  first  serial  correlation, 
rather  than  the  sample  directional  coorelatlons.  Then  using  the  sample 
directional  correlation  based  on  (8.4)  an  estimate  of  6  can  be  obtained 
and  hence  an  estimate  of  a.  Methods  of  improving  the  efficiency  of  these 
moment  estimates  are  being  studied.  Use  of  the  run  probability  given  by 
(8.3)  is  also  a  possible  tool  for  estimation. 


11 .  FURTHER  DEVELOPMENTS 

Further  work  on  this  topic  is  being  directed  at  the  estimation, 
simulation  and  sample  path  aspects.  Extensions  of  the  model  to  mixed 
exponential  variables  are  also  being  developed. 
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NEAR(l)  PROCESS— EAR (1)  CASE 
ALPHA  =  .990,  RHO  =0.75 

BET 


FIGURE  la.  Simulated  sample  path  for  the  EAR(l)  process  of  Gaver  and  Lewis  (1980) 
which  Is  the  special  case  NEAR(l)  process  In  which  a  =  1.0.  (Simulation 
done  with  a  =  .99  to  avoid  computation  problems.)  For  this  case 
P{X^  <  *  '78  and  the  runs  of  falling  values  are  clearly 

discernible. 


NEAR(l)  PROCESS— TEAR(l)  CASE 
ALF^HA  =  .758,  RHO  =  0.75 

BETA  =  .990 


Figure  lb.  Simulated  sample  path  for  the  TEAR(l)  process,  the  special  case 

NEAR(l)  process  in  which  B  =  1.  (Simulation  done  with  B  »  .99 

to  avoid  computational  problems.)  For  this  case  P{X  <X  ,)  =  0.22 

n  n-i 

and  the  predominance  of  runs  of  ascending  values  is  clearly 
discernible . 


31 


Figure  Ic.  Simulated  sample  path  for  the  NEAR(l)  process  which  is  partially 

time-reversible  in  that  the  directional  correlations  are  equal  and 

P{X  <  X  =  1/2,  The  parametrization  for  this  PREAR(l)  process 
n  n-i 

is  B  =  l/(2-a).  Note  that  the  same  i.i.d.  exponential  sequence 
{£_}  was  used  in  the  three  simulations  of  Figures  la,  lb,  Ic. 


NEARA(l)  PROCESS-TEARA(l)  CASE 
ALPHA  =  0.75 
BETA  =  0.990 


Simulated  sample  path  for  the  TEARA(l)  process,  the  special 
case  NEARA(l)  process  in  which  6=1.  (Simulations  done 
with  6  =  0.99  to  avoid  computational  problems.)  Runs  of 
alternating  ascending  values  can  be  discerned,  and  are  produced 
by  the  negative  dependency  in  the  model;  this  compares  with 
the  smoother  run-up  sequences  in  the  TEAR(l)  simulation  of 
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